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DETAILED ACTION 
Response to Arguments 

Applicant's arguments filed 1 1/02/2007 have been fully considered but they are 
not persuasive. 

1. The applicant asserts that the examiner is mistaken in applying the McGrath 
(US Patent No.: 7123816B2) reference as teaching "a plurality of description forms", as 
referred to in Claim 1 at Col. 7, Line 61, to Col. 8, Line. 9. The applicant asserts that the 
McGrath reference fails to teach or suggest that metadata for focus, zoom and panning 
might each include a plurality of description forms, such that one device state would be 
describable in any of a plurality of different ways as in apparatus Claim 1 . 

The examiner respectfully disagrees with this assertion. In the examiner's 
opinion, the McGrath reference still reads on the above argued portion of claim 1 . In the 
examiner's opinion, the supplementary information can be viewed as the metadata 
itself. The apparatus stores main information (video images) and a supplementary 
information (metadata). Each of this supplementary information/metadata has a plurality 
of possible description forms. The description forms of metadata are included in 
Column 7, Lines 61 to Column 8, Line 9. Therefore, in the examiner's opinion, as the 
claim currently stands, the McGrath reference teaches that each supplementary 
information that accompanies the main information (each metadata that accompanies 
the main information) has a plurality of description forms such as focus, zoom etc... 

2. The applicant further asserts that McGrath et al. do not teach or even suggest 
"a determination unit configured to determine, for each supplementary information item 
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having a plurality of description forms, priority for each of the plurality of description 
forms in advance". 

The examiner respectfully disagrees with this assertion. In the examiner's 
opinion, as stated in page 4 of the office action mailed on 08/02/2007 and for the 
reasons discussed above, McGrath et al. teach that priority is determined to be given to 
tlie secondary metadata obtained from ttie metadata generator 34. This metadata is 
given first priority since it is automatically generated during the generation of video 
signals. Therefore, priority is given to the secondary metadata in advance by the control 
processor 28. The metadata input by the user is of secondary importance, Column 7, 
Lines 1 etseq. of McGrath etal. 

3. Finally, the applicant asserts that the McGrath et al. reference does not teach 
a determination unit for pre-assigning priorities to different form. The examiner does not 
see this language in claim 1. Claim 1 instead states that the determination unit is 
configured to determine priority for each of the plurality of description forms in advance. 
In the examiner's opinion, "in advance" has no time frame. "In advance", as it stands, 
could be in advance of any time frame in any given process. The specifics are not 
mentioned. 



Therefore, for the reasons mentioned above, the examiner believes that the 
roforonoc^ can be rejected with the cited art from the previous office action (08/02/2007). 
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Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined In section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and vt/as published under Article 21(2) 
of such treaty in the English language. 

Claims 1-54 and 56-58 are rejected under 35 U.S.C. 102(e) as being anticipated 
by McGrath et al. (US Patent No.: 7123816B2). 

Regarding Claim 1, McGrath et al. disclose an apparatus (Video camera 1 and 
PDA 12 make up the apparatus in Figure 1) for storing main information (video images 
captured by the camera 1) and a supplementary information (metadata) item that 
accompanies the main information, comprising: 

a determination unit configured to d^ermine, for each supplementary information 
item having a plurality of description forms (The metadata (secondary/syntactic 
metadata and metadata added externally by a user via a PDA 12) has a plurality of 
description forms, Column 7, Line 61 to Column 8, Line 9), priority for each of the 
plurality of description forms in advance (Priority is given to the secondary metadata 
obtained from the metadata generator 34. This metadata is given first priority since it is 
automatically generated during the generation of video signals. Therefore, priority is 
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given to the secondary metadata in advance by the control processor 28. The metadata 
input by the user is of secondary importance, Column 7, Lines 1 et seq.); 

a selection unit configured to select a description form to be used in recording in 
accordance with the priority from description forms usable in the apparatus (Processor 
28 also functions as a selection unit configured to select the metadata to be used in 
recording in accordance with priority. The secondary metadata that is automatically 
generated is selected along with the user generated metadata that is input from the 
PDA, Column 7, Lines 1 et seq. to Column 8, Lines 1-46); and 

a recording unit configured to record for recording the supplementary information 
item (secondary/syntactic metadata and user selected metadata) by the selected 
description form in correspondence with the main information (Recording unit 22 stores 
both the syntactic and user selected metadata along with the video images captured by 
the camera 10, Column 8, Lines 10-46). 

With regard to Claim 2, McGrath et al. disclose the apparatus according to claim 
1, wherein said selection unit selects a plurality of description forms to be used from the 
description forms usable in the apparatus in descending order of priority within a usable 
range in consideration of a limitation of the apparatus (limitation of apparatus is whether 
or not user inputs metadata from the PDA to the video camera) (The metadata (plurality 
of description forms to be used) is selected in descending order of priority. The syntactic 
metadata, which is given first priority, is automatically selected and stored in the camera 
1 The metadata input by the user is of secondary/lower priority because it is not 
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automatically input into the camera along with the video images captured and requires 
the user to externally input it into the camera, Column 7, Lines 1 et seq.) 

In regard to Claim 3, McGrath et al. disclose the apparatus according to claim 1, 
wherein said selection unit selects a plurality of description forms to be used from the 
description forms usable in the apparatus in descending order of priority within a usable 
range in consideration of a limitation of the apparatus and simultaneously selects all 
description forms having priority higher than the lowest priority in the selected 
description forms (The metadata (plurality of description forms to be used) is selected in 
descending order of priority. The syntactic metadata, which is given first priority, is 
automatically selected by the processor 28 and stored in the camera 1. The metadata 
input by the user is of secondary/lower priority because it is not automatically input into 
the camera along with the video images captured and requires the user to externally 
input it into the camera, Column 7, Lines 1 et seq.). 

Regarding Claim 4, McGrath et al. disclose the apparatus according to claim 1, 
wherein when the description forms usable in the apparatus include description forms 
that cannot be simultaneously used because of a limitation of the apparatus (Metadata 
input by the user from the PDA cannot be simultaneously used with the syntactic 
metadata when the PDA does not transmit the metadata to the camera (limitation of the 
apparatus)), said selection unit (processor 28) selects one description form having high 
priority for the description forms (The processor 28 selects the syntactic metadata (high 
priority metadata), and for the remaining description forms, selects the plurality of 
usable description forms to be used in descending order of priority. Once the metadata 
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is later input from tlie PDA, tlie processor 28 selects the plurality of metadata 
(remaining description forms) to be used. The priority is first given to the syntactic 
metadata and finally to the user input metadata (descending order), Column 7, Lines 1 
et seq. to Column 8, Lines 1-46). 

With regard to Claim 5, McGrath et al. disclose the apparatus according to claim 
1, wherein when the description fonvs usable in the apparatus include usable 
description forms whose number or combination is limited because of a limitation of the 
apparatus, said selection unit selects description fonris having high priority as many as 
possible within the limit (When the description forms usable in the apparatus (user 
selected metadata and syntactic metadata) is limited because the user only inputs a 
certain amount of metadata, the processor 28 selects as many description forms having 
high priority (syntactic metadata) as are present (within limit), Column 7, Lines 1 et 
seq.). 

In regard to Claim 6, McGrath et al. disclose the apparatus according to claim 1, 
wherein said selection unit selects a description form to be used (syntactic metadata) 
from the description forms usable (syntactic and user input nr^tadata) in the apparatus 
in descending order of priority within a usable range in consideration of a limitation of 
the apparatus (The processor 28 selects the syntactic metadata (high priority metadata) 
first, and for the remaining description forms, selects the plurality of usable description 
forms to be used in descending order of priority. Once the user input metadata is later 
input from the PDA, the processor 28 selects the plurality of metadata (remaining 
description forms) to be used. The priority is first given to the syntactic metadata and 
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finally to the user input metadata (descending order), Column 7, Lines 1 et seq. to 
Column 8, Lines 1-46), and changes a storage location (data store 32 and magnetic 
tape 22, Figure 2) of the supplementary information (combination of both metadata) 
item on a storage medium in accordance with the priority (McGrath et al. teach that the 
syntactic metadata (dateAime) is stored in a separate area (data store 32) of the entire 
storage medium (magnetic tape 22 and data store 32) than the user input metadata 
(which is stored only in the magnetic tape 22), Column 7, Lines 1 et seq. to Column 8, 
Lines 1-46). 

With regard to Claim 7, McGrath et al. disclose the apparatus according to claim 
6, wherein in changing the storage location of the supplementary infomiation item on 
the storage medium, said selection unit stores a supplementary information item with a 
description form having high priority at a storage location, with which storage or retrieval 
is easy (McGrath et al. teach that the syntactic metadata (date/time) is stored in a 
separate area (data store 32) of the entire storage medium (magnetic tape 22 and data 
store 32) than the user input metadata (which is stored only in the magnetic tape 22), 
Column 7, Lines 1 et seq. to Column 8, Lines 1-46). 

Regarding Claim 8, McGrath et al. disclose the apparatus according to claim 6, 
wherein in changing the storage location or storage scheme of the supplementary 
Information item on the storage medium, said selection unit (processor 28) stores 
supplementary information at a storage location, with which storage of the 
supplementary information item is easy, in an order of priority of the description form 
(McGrath et al. teach that the syntactic metadata (date/time) is stored in a separate 



Application/Control Number: Page 9 

10/693,877 

Art Unit: 2622 

area (data store 32) of the entire storage medium (magnetic tape 22 and data store 32) 
than the user input metadata (which is stored only in the magnetic tape 22). Processor 
28 stores the syntactic metadata first in the data store 28 before proceeding to include 
the user input metadata, Column 7, Lines 1 etseq. to Column 8, Lines 1-46). 

In regard to Claim 9, McGrath et al. disclose the apparatus according to claim 6, 
wherein in changing the storage location of the supplementary information item on the 
storage medium, said selection unit defines in advance a rule to assign a description 
form having specific priority to each of a plurality of storage locations the storage 
medium and determines the storage location in accordance with the rule (McGrath et al. 
teach that the syntactic metadata (dateAime) is stored in a separate area (data store 32) 
of the entire storage medium (magnetic tape 22 and data store 32) than the user input 
metadata (which is stored only in the magnetic tape 22). Processor 28 stores the 
syntactic metadata first in the data store 28 before proceeding to include the user input 
metadata. The rule is that syntactic metadata (high priority metadata) is always stored 
first in data store 32, Column 7, Lines 1 et seq. to Column 8, Lines 1-46}. 

With regard to Claim 10, McGrath et al. disclose the apparatus according to 
claim 6, wherein in changing the storage location of the supplementary information item 
on the storage medium, said selection unit defines in advance a rule to assign a 
description form having specific priority to each of a plurality of storage locations on the 
storage medium for each supplementary infonrtation item to be recorded and 
determines the storage location or storage scheme in accordance with the rule 
(McGrath et al. teach that the syntactic metadata (date/time) is stored in a separate 
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area (data store 32) of the entire storage medium (magnetic tape 22 and data store 32) 
than the user input metadata (which is stored only in the magnetic tape 22). Processor 
28 stores the syntactic metadata first in the data store 28 before proceeding to include 
the user input metadata. The rule is that syntactic metadata (high priority metadata) is 
always stored first in data store 32, Column 7, Lines 1 et seq. to Column 8, Lines 1- 
46). 

Regarding Claim 11, McGrath et al. disclose the apparatus according to claim 1, 
wherein 

the apparatus is a moving image sensing apparatus (Video camera 1 can 
capture moving images, Column 6, Lines 9-24), and 

the main information is a moving image (Column 6, Lines 9-24), and the 
supplementary information (metadata) item contains at least one of information of an 
image sensing device, state information of an optical device, information related to 
user's operation, and information related to a photographing environment at the time of 
photographing (Column 7, Lines 61-67 and Column 8, Lines 1-4). 

With regard to Claim 12, McGrath et al. disclose the apparatus according to 
claim 11, wherein when a plurality of devices (sensors 38,40 and 42 in camera 1 in 
addition to the PDA 12) to the supplementary information item (user generated 
metadata and syntactic metadata) are present (Column 7, Lines 1 et seq.), the device 
whose information is to be selected and stored is determined in descending order of 
priority (Metadata generated from within the camera (syntactic metadata), which is 
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given first priority, is automatically selected and stored in the camera 1. The metadata 
input by the user via the PDA is of secondary/lower priority because it is not 
automatically input into the camera along with the video images captured and requires 
the user to externally input it into the camera, Column 7, Lines 1 et seq.). 

In regard to Claim 13, McGrath et al. disclose the apparatus according to claim 
11, wherein when acquisition of information from another device (PDA) has limitation 
(The limitation of the apparatus is the time where the user decides to input metadata 
from the PDA to the video camera), another device whose information is to be selected 
and stored is determined in descending order of priority (The metadata (plurality of 
description forms to be used) is selected in descending order of priority. The syntactic 
metadata, which is given first priority, is automatically selected and stored in the camera 
1. The metadata input by the user is of secondary/lower priority because it is not 
automatically input into the camera along with the video images captured and requires 
the user to externally input it into the camera. Column 7, Lines 1 et seq.) 

Regarding Claim 14, McGrath et al. disclose the apparatus according to claim 
13, wherein the limitation is limitation related to a time in which the information is 
acquired from another device (PDA), (The limitation of the apparatus is the time where 
the user decides to input metadata from the PDA to the video camera). 

With regard to Claim 15, McGrath et al. disclose the apparatus according to 
claim 13, wherein the limitation is limitation related to a temporary storage amount of the 
information acquired from another device (The user generated metadata is temporarily 
stored in the PDA before it is input into the video camera. Column 7, Lines 1 et seq.). 
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In regard to Claim 16, McGrath et al. disclose the apparatus according to claim 
11, wherein when arithmetic operation of simultaneously converting information from a 
device (camera 1) into a plurality of unit systems (data store 32 and tape drive 22) has a 
limitation (Metadata of the syntactic kind is converted/calculated to a form useable for 
the processor 28 and stored in data store 32. The processor 28 eventually transfers it to 
the tape drive 22. The limitation is that the processor 28 has to wait for the user input 
metadata from the PDA to the camera. The PDA user input metadata is 
converted/calculated in the interface unit 18 to a form useable by the proces^r 28. 
Here it is combined with the syntactic metadata and sent to the tape drive 22, Column 
17, Lines 1 et seq. to Column 8, Lines 1-46), the unit system to be selected is 
determined in descending order of priority (The unit system (data store 32 or tape drive 
22) is selected in order of priority, the data store 32 is selected first since it automatically 
receives metadata from within the video camera 1. The user input metadata which is 
only stored in the tape drive 22 is of a lower priority because it is not automatically input 
into the camera along with the video images captured and requires the user to 
externally input it into the camera. Column 7, Lines 1 etseq.). 

With regard to Claim 17. McGrath et al. disclose the apparatus according to 
claim 16, wherein the limitation is a limitation related to a time in which the information 
from the device (camera 1) is simultaneously re-calculated to the plurality of unit 
systems (data store 32 and tape drive 22) (The limitation is that the processor 28 has to 
wait for the user input metadata from the PDA to the camera. These signals then have 
to be converted/calculated into a form by which the processor 28 can process them. 
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Conversion/calculation to the syntactic metadata is also performed in the secondary 
metadata processor 34 and sent to the data store 32. Every time a new image is 
captured, the signals are simultaneously re-calculated/converted. Syntactic metadata is 
then sent to the data store 32 and once in the processor 28, the user added metadata 
is combined with the metadata from the data store 32 and sent to the tape drive 22, 
Column 7, Lines 1 et seq. to Column 8, Lines 1-46). 

Regarding Claim 18, McGrath et al. disclose the apparatus according to claim 
16, wherein the limitation is a limitation related to a temporary storage amount of the re- 
calculated information (The limitation is that the processor 28 has to wait for the user 
input metadata from the PDA to the camera before it can combine it with the syntactic 
metadata to send to the tape drive 22. The PDA user input metadata is converted and 
calculated in the interface unit 18 to a form useable by the processor 28 where it is 
temporarily stored and combined with the syntactic metadata. Re-calculation is done 
each time the user sends metadata from the PDA to the processor 28, Column 17, 
Lines 1 et seq. to Column 8, Lines 1-46). 

In regard to Claim 19, McGrath et al. disclose the apparatus according to claim 
16, wherein the limitation is a limitation related to an arithmetic capability for 
simultaneously re-calculating the information from the sensor (sensor 38 in video 
camera 1, Figure 2) to the plurality of unit systems (data store 32 and tape drive 22) 
(The limitation is that the processor 28 has to wait for the user input metadata from the 
PDA to the camera. These signals then have to be converted/calculated into a form by 
which the processor 28 can process them. Conversion/calculation to the syntactic 
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metadata is also performed in the secondary metadata processor 34 and sent to the 
data store 32. Every time a new image is captured, the signals are simultaneously re- 
calculated/converted. Syntactic metadata is then sent to the data store 32 and once in 
the processor 28, the user added metadata is combined with the metadata from the 
data store 32 and sent to the tape drive 22, Column 7, Lines 1 et seq. to Column 8, 
Lines 1-46), 

Regarding Claim 20, McGrath et al, teach of the apparatus according to claim 
16, wherein the limitation is that the information from another device contains 
unacquired information (The user input metadata sent from the PDA is not acquired by 
the camera automatically (unacquired information). Column 7, Lines 1 et seq.) . 

With regard to Claim 21, McGrath et al. disclose the apparatus according to 
claim 1 1, wherein when information from another device can be simultaneously 
described by a plurality of forms (Multiple/different metadata from the PDA, Column 7, 
Lines 65- Column 8, Lines 1-4) , and limitation related to the description is present 
(The limitation of the apparatus is the time where the user decides to input metadata 
from the PDA to the video camera), the another device whose information is to be 
selected and stored is determined in descending order of priority (The metadata input 
by the user is of secondary/lower priority because it is not automatically input into the 
camera along with the video images captured and requires the user to externally input it 
into the camera. This metadata is selected by the processor 28 and stored in the 
storage section 22, Column 7, Lines 1 et seq.) 
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Regarding Claim 22, McGrath et al. disclose tlie apparatus according to claim 
21. wherein the limitation is a limitation related to a time usable for the description (The 
limitation of the apparatus is the time where the user decides to input metadate from the 
PDA to the video camera). 

With, regard to Claim 23, McGrath et al. disclose the apparatus according to 
claim 21, wherein the limitation is a limitation related to an amount of information that 
can be described (The limitation of the apparatus is the time where the user decides to 
input metadata (amount of information that can be described) from the PDA to the video 
camera, Column 7, Lines 1 et seq.). 

In regard to Claim 24, McGrath et al. disclose the apparatus according to claim 
11, wherein the priority is defined in accordance with easiness of information acquisition 
(The metadata (plurality of description forms to be used) is selected in descending order 
of priority. The syntactic metadata, which is given first priority, is automatically selected 
and stored in the camera 1. The metadata input by the user is of secondary/lower 
priority because it is not automatically input into the camera along with the video images 
captured and requires the user to externally input it into the camera, Column 7, Lines 1 
et seq. Automatic acquisition of metadata is easier than manual acquisition of 
metadata). 

With regard to Claim 25, McGrath et al. disclose the apparatus according to 
claim 11, wherein when information from another device (information from the PDA 12) 
can be simultaneously described by a plurality of forms (plurality of metadata), each 
body of information is described while dividing a storage region (Storage regions 32 and 
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22) for the priority that is defined in advance for each form of information (The syntactic 
metadata (date/time) is stored in a separate area (data store 32) of the entire storage 
medium (magnetic tape 22 and data store 32) than the user input metadata (which is 
stored only in the magnetic tape 22). Processor 28 stores the syntactic metadata first in 
the data store 28 before proceeding to include the user input metadata. The rule 
selected in advance is that syntactic metadata (high priority metadata) is always stored 
first in data store 32, Column 7, Lines 1 et seq. to Column 8, Lines 1-46). 

Regarding Claim 26, McGrath et al. disclose the apparatus according to claim 
1 1, wherein when information from another device can be simultaneously described by 
a plurality of forms, each body of information is selectively described in accordance with 
a storage region (32 and 22) that is defined in advance for each form of information 
(The syntactic metadata (date/time) is stored in a separate area (data store 32) of the 
entire storage medium (magnetic tape 22 and data store 32) than the user input 
metadata (which is stored only in the magnetic tape 22). Processor 28 stores the 
syntactic metadata first in the data store 28 before proceeding to include the user input 
metadata. The rule selected in advance is that syntactic metadata (high priority 
metadata) is always stored first in data store 32, Column 7, Lines 1 et seq. to Column 
8, Lines 1-46) 

With regard to Claim 27, McGrath et al. disclose the apparatus according to 
claim 26, wherein the storage region of each information is defined in accordance with 
easiness of information acquisition (The syntactic metadata (date/time) is stored in a 
separate area (data store 32) of the entire storage medium (magnetic tape 22 and data 
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store 32) than the user mput metadata (which is stored only in the magnetic tape 22). 
Processor 28 stores the syntactic metadata first in the data store 28 before proceeding 
to include the user input metadata. The rule selected in advance is that syntactic 
metadata (high priority metadata) is always stored first in data store 32. Also, automatic 
acquisition of metadata is easier than manual acquisition of metadata Column 7, Lines 
1 et seq. to Column 8, Lines 1-48). 

Regarding Claim 57, McGrath et al. disclose the apparatus according to claim 1, 
wherein the supplementary information item (metadata) corresponds to one or another 
of plural types of device status (Different kinds of metadata are generated by the 
camera and the PDA), and the plurality of description forms (different kinds of metadata) 
correspond respectively to a plurality of descriptions describing one type of device 
status in a plurality of different ways (The different kinds of metadata, whether it comes 
from the camera or the PDA, describes the status (time, date etc..) of the device in 
many different ways). 

With regard to method claims 28-54, 58 and computer program and computer 
program storing claim 56, these correspond to apparatus claims 1-27 and are therefore 
analyzed and rejected as previously discussed with respect to apparatus claims 1-27. 
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Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or eartier communications from the 
examiner should be directed to Pritham Prabhakher whose telephone number is 571- 
270-1128. The examiner can normally be reached on M-F (7:30-5:00) Alt Frida/s Off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on (571 )272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Pritham David Prabhakher 

Patent Examiner 

Pritham. Prabhakher@uspto.qov 
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